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Introduction; 

The following algorithm has been suggested by Decell and 
Smiley In fll for optimal linear combinations in the feature 
selection problem. 

Let V be a continuous function from Mjj (see definition 1) 

into that Is Invariant under multiplication on the left 

by kxk invertible matrices. Then there exists ^ 

1 n 

(see definition 2) such that 

H ) - l.u.b.f ^ ( Lljz] H )}. 

Now for each positive Integer 1, let the element H f r/ 

' n 

be chosen such that 

^( = l.u.b. 

H€^n 

The question of whether or not the above process terminates 
at an absolute ^-extremum (rank k maximal statistic) appeared in 
[1]. In this paper, we show that there exists a function ^ as above 
for which the above process does not terminate at an absolute 
y -extremum . 

Let be the matrices representing Householder trans- 
formations. Then for the matrix z] • • *Hp, let 0 ( • • • H^) 

be the span In R” of the k row vectors of that matrix. Suppose 
that v^,...,Vj^ are linearly independent vectors in R*^. Then we show 
in this paper that there exists some integer p ^ mln(n,n-k) and 
Householder transformations whose matrices are H for which 


/ 
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• • *Hp) ■ Span^^v^, . . . ,V|^j . We also determine the minimum 

integer p having the above property , 

/ 

Preliminaries; 

Definition 1. Let be the set of all kxn rank k matrices. 

n 

Definition 2. Let denote the set of all Householder trans- 
formations . 

Definition 3. Letj^j^ denote the collection of all vector 
subspaces of R*’ of dimension k. 

Definition ^ . Let s" * f x€ r" I Ifxll » 3 } . 

Definition 5. LetCbe a closed subset of R*^ and x^C- Then 
there exists c € C such that l|x-c„l/ ^ Jfx-ci!f for any 

X X 

ccC. Let p(x;C) ■ //x-Cj^/Z . 

Definition 6. Let A and B be elements • Then there exists 

an element a* G aO having the property that 
p(a*; bHs*^) - ^(a; BHS”) for all aCADs”. The num- 

ber p(a*; BOs”) will be called the distance from A to B 
and will be denoted by the symbol d(A;B). 

Proposition 1. For any elements A, B, and C in ^ 

1) d(A;B) - 0 and d(A;B) * 0 if and only if A « B. 

11) d(A;C) « d(A;B) + d(B;C). 

ill) For any ^ 0 there exists such that whenever 

d(A;B) ^ <T , then d(B;A) ^ f . 

Definition 7. For any PG and 0, let 

d(X;P)-t 

Definition 8. Let T be the topology on^J^ determined by the 
subbasis 0 and | • 


3 


Definition 9. Let C be a closed subset of -^n‘ 

Let D(P; C ) - g.l ,b. ^d(P;C) | ceC]. 

Proposition 2, normal. 

Proof: Let I? and ^ be two closed disjoint subsets of^J^. 

Let » {pe^jj I D(P;^) D(P;^)j and 

/S)] . By Proposition 1, 

we can determine that and Ij^ p are both, open and are 


disjoint. This completes the proof. 


Definition 10. For any vector w 


Vl 


in R*^, let w^ * 


w 


n^ 




i''k 


and w^ = 


’^k+ll 


'n 


Proposition 3. Suppose that | > • • • | a collection of 

linearly independent vectors in R^. Lev p be the dimen- 
sion of Span v^, . . . ,v^ I and assume p.:^ 0. Then there 
exists a vector x € R*^ such that Ifxll » 1, and If Is 
the Householder transformation determined by x, then the 
dimension of Span . . . ,Hjj(vj^)^ ^ = p-1. 

Proof : Case 1) Dimension of Span v^j^, . . . ,v|^ j is less 

than k. We select a vector x^ In Span ^ v^ , . . . , v^ j such 
that llx^H Since |]v^-2(v^*x^)x^J *x^ ■ 0 for 

1=1,..., k. It follows that the dimension of 
Span I v^-2(v 2 ‘X^)x^, . . . ,vj^-2(v'^.x^)x^] is p-1. Now by 
assumption there exists a vector x^ in R*^ such that 
lIxUll . /T, and v^.x^ = 0 for 1=1,..., k. Since 
v^-2(v^*x)x^ » v^-2( v^.x^) x^, then the dimension of 
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Span Jv^-2(vJ^.x^)x^, . . . ,v^-2(v^.x^)x^ ] Is p-1, for 

Case il) The dimension of Span^v^, . . . ,vjj j ■ k. 

We select a vector Xq in Span • • • • with |(x^||«y^ 

Then we have that the dimension of 

Span [v^-2(vJ'.xL)x^, . . . ,vJj-2(vJj.x^)Xq j is p-1. We 

assume then that x^ ■ A x^ for some 1. We want a 

® 1 2 
vector in such that If x * |x|^j then Wx^l) + 

2 

llx^ll * 1 and v5'-2(v. .x)x^ » v5'-2(vj'.x^)x^ for i»l,...,k 

lloo 

f 

By substituting into this equation In place of x^ we 

can determine that vj.x^ * l»l,...,k. 

By our assumption we can find a vector x^ satisfying the 
above equations whenever a choice of A Is made. We ob- 
serve that if A approaches 1, then llx^ll must approach 

0, and llx^ll must approach so that if A approaches 

2 2 — 

1, then llx^li + lixMr must approach V%. If A approaches 

0, then lIxUll approaches +oo and llx^H approaches 0 
2 2 

so tl xW + II x^il approaches +oo as A approaches 0. 

It follows from this that there exists some A for which 

y uO 

11x^11 + H x^ll • 1. Thus we have the dimension of 

Span[v^-2(v^.x)x^, . . . ,v^-2(Vj^.x)x^| is p-1 which is the 
required condition. This completes the proof of proposition 

3. 
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Definition 11. For any Mc let 0(M) ■ Spanjvj^, . . . ,Vj^j 

where { . ,Vj^ j are the row vectors of M. d Is easily 
seen to be continuous . 

Proposition Suppose that 0 . .Hp) ■ Span|v^ , . . . ,v 

for Householder transformations H, , . . . . Then the 

1 p 

dimension of Span[v^, . . . j cannot exceed p. 

Proof: We observe first of all that for any collection 

of vectors [ Householder transformation 

Hjj determined by the vector x that 

Span|Hjj(y^ Hjj(yjjj) j C Span[y^ , . . . ,y^,x| .. 

Now 0 ([Ij^|z]h^. . .Hp) • Span^Hp.. .H^(ej^),...,Hp...Hj^(ej^)j 
where e^ is the vector with 1 In the 1^^ place and 0 
everywhere else. Thus by the above statements, 

Span[v^, . . . ,Vj^|C Span|e^,. . . ,Cj^,x^, . . . ,Xp| . 

It follows that Spanjv^, . . . ,v^|c Spanjx^, . . . ,Xp | . 

Thus the dimension of Span|v^, . . . ,v^| IS less than or 
equal to p. This completes the proof of Proposition 4. 

Proposition 5. For linearly Independent vectors | ,Vj^| , 

If p is the dimension of Span^v^, . . . ,v^ j and p^O, then 
there exists Householder transformations H, 

1 P 

such that 0 (fl^l zJHj, . .Hp) ■ Span|v^ , . . . ,Vj^| and no 
fewer than p Householder transformations can have this 
property . 

Proof : This Is a consequence of Propositions 3 and 4 . 


/ 
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Construction of the map ^ 

Definition 12. For any let P - Span^v^ , , . , and 

define L(P) ■ the dimension of Spanjv^, . . . . 

Definition 13. For O^p^n-k let ^p “ [AcJnlL(A)*p]. 

Proposition 6. is closed for p«0,...,n-k. 

Proof ; This is a consequence of the fact that if 
l^u^ , . . . ,Ujjj^ Is a collection of vectors In and q 

Is the dimension of Span^Uj^ , . , . ,u^| then there exists a 
real number such that if j|u^-uj|| for i«l,...,m, 
then the dimension of Span^uJ , . . . ,u»^ Is greater than or 
equal to q. This completes the proof of Proposition 6, 


Now for some pe^^ there exlsts^-^0 such that If then 

does not contain P. Let be the closure of 

. By Urysohns lemma, [2] there exists a continuous 
function :^[5->[o,l] C such that<^j^(P) * 1 and <^^(A)=0 
for any kc(f. Let I » Span[e^ , . , . ,ej^| , Thenli^(I)C(J 
since le Define a map 

(^ 2 (X) » 0 if and <t> 2 (X) - g-d^X;I) If XCt^j^I). 

Let (P *4^2 ^ ^2 define V We observe that 

Si -0([[l,tlz]H| Hcyj) . Also If 0 ([tJz]h^) - I 
for some H^C then for any H€^^, 0 ( [l J zj . 

That V has the desired properties follows from the fact that 
the function ^ has a maximum value of H at I over the set 
but 4) has a maximum value of 1 at P over the entire space 
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